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as the result of a competitive bidding procedure, to National Evaluation Systemé, : 
Inc. (NES), a firm that has developed i iepleape minimum competency tests, — ; 
under contract to State and local education agencies. —. ; os 3 
The purpose of this contract was to obtain previously unavaflable descrip- 8 
._tive information about minimum competency testing programs_for the_enlightenment a 


of educators, researchers, and others’ interested in this area. ‘Trformation on 
the consequences or impacts of these-programs was not within the ope of work | 
for this contract. However, NIE. is currently;planning a cqmplementary study 
‘that will focus on program impdcts.. ae : . ae | 


- Fn obtaining the descriptive information presented here, the NES project . 
staff, during the spring of 1979, intervieweds the directors of all State . a 
minimin competency testing programs and of 21 local district programs. Subsequent 


.. to these. visits, NES staff developed written program. descriptions, and these were 


sent to the program directors for verificatiqn> It is these yerified program 
descriptions that form:the basis for this repérty ee | 
It should be emphasized that the information presented here provides a, 
snapshot'of the status of minimum competency testing programs a8 of June 30, 1979, 
and, owing te the dynamit nature of these pro rams, may not portray the programs 
as they are operating today. | . 


‘Further, it should be emphasized that an} opinions éxpressed in this report 


. do not necessarily reflect NIE or HEW position or policy, .and no endorsement of. 
minimm competency testing or of any mode} destribed in this report by ‘NIE or 
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EXECUTIVE SUMMARY 


: The Sian y and Analysts: Report for the "Study of Mindmum Competency ki ge 
ae Testing Programs" is based upon-.information gathered about. 32 state and 20 2 ty 
* local district ‘testing programs around the United States and documented in’ *.. 

the Comprehensive Report. On-site visits were conducted for the purpose 
| of’ collecting information, .both published: and informal, about each, pro- 
Fon 's-policy history, goats, competenctes assessed, grade- ‘levels- targeted —— 
or "assessment, test. instruments, performance standards, test administra- a 
‘tion and. dissemination, provisions for special populations, program - \: 
resources, evaluation, and future directions. While one set of discussion: 
‘guide ttnes provided’ a framework for the conduct of each site visit, the 
.. collection of published documents about a program before the visit "enabled 
. oo thesinterviewer ‘to focus on those questions. which were not answered by the 
Love . documents’. Each. site visit, reer ors was: tailored to the particular 
ae program: under study. . 
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x The format of the. ork follows that of the individual program 
‘descriptions included in the Comprehensive Report; major trends are 
__* suman ized: within each section and notable exceptions to the trends are. 
_ presented. The +eport was prepared by Marcy-R. Perkins, with assistance 
ocfrom Anne Frost. and.Mary Tobin and input and reviéw from: them Gorth. 
“In the: following: baregr ants is a brief summary of. ‘some oy the m noe ~_ . 
o Vghts of. the Study. ; 


© fs S{xteen of - the 31 ebate: level programs were endated. by the state 

Board: of Education, ‘and 15 were initiated by.the state. legislature. Two 
of the legi$lated mandates call for temporary prograins;: one State Board-. 
tnitiated program and one legislated program permit voluntary participa- 

7 tion of: local school. districts. Two: other states. emphasize the competency- 

” pased Instructional, aspects of their programs eeener than the ns 
components . : . 


. Of the 20 toca) 6 programs studied, "tive ‘aeons dn states. mcd 
statewtde requirements for minfmum comp&tency testing. Of the remaining 
ae 15 districts, eight began instituting minimum ts "igpenent testing-pro pans 
-¢ . prtor to ‘state mandates, white. seven districts een ed programs 
a oe to such mandates . > o a ee oa ee 
“the majority of programs , both ‘state. and local, were iva taped in the 
two to three years since 1976, but the age of programs ranged from 18 
. veo to ‘less than. one ae with puvee pilot- eee Fourteen ‘state 
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programs have been fully implemented, while 17 aré being phased in. For 
example, many state programs are introducing new graduation requirements-. 


ae will not be "in. place" ‘until some time in the future. By comparison, 160° os Oe 


of the 20 local programs. have already been fully-(mplemented, while seven 
programs are phasing in mandated changes. ©. ‘ ‘ 

ae Programs in only four states have had litigation associated with them a 

_— in amy way--Delaware, Florida, Maryland,’ and North Carolina--gnd the major-- 

- ity of this activity has occurred in Flortda. - - he &: 


With respect to goals ard purposes, 14 states cited certification of  — 
basic skills competency prior to high schoo] graduation as a major pur- | 
pose, and two states reported using competency achievement as one crite- 
‘nion for grade-to-grade promotion as a reason for implementing’ a minimum 
competency testing program. The most frequently cited purpose far insti- 
a tuting such a program was to !déntify students in need of remediation; 19 
ee. states reported this purpose. Cufriculum improvement was mentioned by 10 
states as a major program goal. By comparison, 16 local districts reported 
certification of basic skills as one reason for developfng a minimum co- 
Bacal testing program; fodr districts cited the use of test results, - 
along with other information, to determine grade-to-grade promotion as a 
major purpose of the program. Eleven programs reported purposes elated 
" to providing remediation and seven districts mention curriculum change as 
a major purpose behind program implementation. > oe v. 


ee, Reading and mathematics were competehcy areas assessed in all state 
? and local programs. Twenty-seven of the state programs assessed skills in 
: language arts and/or writing, while 15 local districts assess these same 
"skills. Skills in other subject areas, such as speaking, listening, con- 
Sumer economics, Science, government, and history, are assessed in only a 
few programs. Almost all of the tests administered in both state and. — 
. + local programs consist primarily of multiple-choice items, and a writing 
sample is the most frequently selected non-multiple-choice assessment... 


Regarding provisions made for special. populations, about two-thirds" 
of all programs studied specifically mentioned the sear CA special 
education/learning disabled students. The second most frequently men- ~ 


tioned population was that of limited ay Mabe eet students. A few -. : 
0 


programs also. make provisions for transfer students, four state programs: 
leave decisions about special populations to the local school districts, 
and a few programs are still in the process of decidimg what provisions. 
should be made for whom. The types of provisions made in various. pro- 
" grams, on an individual ‘or group basis, included exemption from testing, © 
administering tests with different formats (e.g... Braille, taped), and: 
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pave ta differential standards” ‘to be established. - In 4 few programs, - a oe 
special education students are tested under. other programs and in a few o-. 
others,” decisions are made “strictly: ona case= by=Case basis.” ee ee 


Staffing for ‘competency testing programs comes most frequently from , eee 
assessment divisions of the stat@ and local agencies, with the curriculum ee 
divisions providing most of the programs' remaining Support. Of the state. 

programs, 20% are funded by state monies and the remainder require program ro 
‘Support to cone from the local districts. In most Yaa the local. pres . a Fe 
grams. are: Supported by local district funding. 2 | 


_ instruments and remedial programs. and deve 


“a few are planning. to expand testing to include other eunvect areas. ¥i 
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Commonly expressed future seals of programs include ioe aan, test. 
etn systems for accurately 
-assessing program impacts on the school systems. Some programs are begin- 
ning to explore the poss{bility of testing more life-oriented ‘s#ills, and 
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oy . Introduction 
"The purposes of the Summary-and Analysis Report are to summarize = 


major trends in state and local minimum competency testing programs, - 
highlight similarities and differences among the various programs, and. 

- analyze future directions for minimum competency testing. For consistency 
and ease. of access to information, this report follows the format of the . 
Comprehensive Report of mjnimum competency testing programs, on which this 

report is based, Therefore, sections of the report contain summaries 


~~——"agross all state-and-tocal programs-pertaining to-palicy,phase-of-impte=————-° ~~ 


“mentation, litégation, goals and purposes, competencies, standards, test- 
ing, administration and dissemination, provisions for special. populations, — - 
staffing, program evaluation, and future directions. oe 


In the original Request for Proposals (RFP) for the study of Intnimum 
competency testing (MCT) programs, 34 state programs were targeted for. 
site visits, including Massachusetts, the pilot.test site. Between the 
time the RFP was issued and the time of the site visits, two additional. 
states eg and South Caroljna) had mandated MCT and were therefore 

~included\in the study, making a total of 36 sites to be visited. | 
‘ During the course of the. study, four of the 36 programs were found 
to be lacking in one or more components that define minimum competency 
, testirig, and one has not implemented its MCT mandate. These were, respec- 
tively: C&lorado, Indiana, Oklahoma, Washington, and Wyoming.. For the 


purposes of’,the study, MCT programs.were defined as'those which both set ‘ie 


- desired performance standards and -also,define consequences that affect 
‘students as ja result of meeting, or not meeting; the standards (e.g., 
remediation,ythe receipt of & High school diploma, etc.). The reasons. 
that Colorado, Indiana, Oklahoma; and Washington did not meet these crite- 


ria are i lustrated: in the brief descriptions of these programs which 
follow: an oe 5 . pe 
: its legislation restricts only those local 
: districts that choose to adopt MCT; there is, 
: however, “no statewide requirement for MCT.° * | 
| te a comprehensive assessment and pTarining process : 
“He is called for in this state, but, in this 
fe process, setting eee and 
Aes. "consequences are not mandated®. —— | 
. only a statewide assessment is conducted here, 
with no standards set. or consequences defined. - 
a : ? 
’ ce ‘ 7 
owe 4 ee 
Supt : “ 
, <) fy : : 0 
oe sn 7 | te 
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(4) WASHINGTON: accountability legislation provides for state; °° 
— . s wide assessment and remediation, but MCT 4s note Oe 


7} The state. which has, not. implemented the mandate for MCT. 1s: Wyoming,. a 
and it has. set no time schedule for implementation. These five programs, . ae. 

therefore, have been excluded .from in-depth description and from summary 4 

statistics. ‘Gag ¢ ©. se 

' . _ ee ee 7 nee 
———---—-Finatty, although Texas has-how mandated MCT -at-the-state- Tevet; tht s:—— ee 
action occurred too late for it to be included in the study; a ‘Tocal dis+ 

trict in Texas was selected, however, to help represent uct activity’ tn. 

that state: The final number of state programs upon Which this report ‘is ' 

based, therefore, is 31. —— ie ae | oo of 


rams, a sample of 21 were selected for 
programs that. the local district summary 

— statistics presented in. report are based; the omitted .program under- 
went ‘a change -in managem and design during the course of the study, so. 
that its results could not be verified in time for inclusion in this” 
‘report. In order to select these programs, 169 locat district MCT pro- 
grams..weré initially identified, of which 52 (representing a mix with. _ 
respect .to locality and state versus no state mandate) were surveyed for 
such information as program goals and purposes, relationship to state pro- 
grams, standards and the methods by which they are set, grades assessed, ~ , 

usas of:test results, provisions for.special student populations, invodve- © 0 |. 
ment of a variety of audiences in. planning, and features unique to a pro- “ha 
gram in the view of the program contacts. After a careful consideration — eo. 
of the results of the survey, the specific programs were selected to - 

- represent the wide diversity of MCT activities in different. regions of the = ‘ 
country, and in states with different requirements. Of the-20 districts 
selected, five districts are in states which have to date not “issued apni 
dates for T@nginun competency-testing. Of the remaining 15 districts, 


With qrespect . to’ local 
Study. It®is upon 20° of 


seven developed programs in response to either Staté Board or legislative | 
“action, while eight districts implemented programs in advance of such ~ 
actions = a: _ 6 1 > os 
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- Legislative, and Policy History i ti, _— 


-. Policy history. Of the 31 state minimum. competency programs studied, * . oe 
. 16 were mandated. by the State Board of Education (SBE) and 15 by the state  - 
~ ‘legislature. These are listed in Table 1. While, for the most: part, 
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ences which should: be noted: -In-Michigan, for example, §-combination of,-- .- ae 
legislative and State Board policy structures the program, and in’ Nevadacse 
.  legislative-action superseded SBE poltcy. In, Delaware ad ‘Arizona, the (-  -. 0 ous 


emphasis is onthe. performance-based or’ competency-based aspects of their +)...” es 
oo testing programs, and/or both, verification of competency achievement’. ta tS 


"Legislation or Board policy specifies the requi tiles and var Yous:raspoas 0 
bilittes for implenenting MCT programs, theré are *some-importart differs 


occurs at the local level. © | . 
. = In addition to. differences ‘such as. these, there arevarfations inthe 2 07 wa 
~ ooh ypesof state mandates; -the-major_types.of.mandates..and the states having. 
7 such mandates are’ listed.#n Table 2. Most common’ were mandates {Ssued a. se 
- the state level that “express a-comm{ tient ‘to: {mplementittg aminimum com = 
oe patency: testing program and? require“all distrfcts to develop suth: program$. © 0235) 
States with this type of mandate differ. in terms of the responsibilittes => =. 

. eundertaken by the state and local. agencies. ‘In Florida, for example, the 
aa state has ee ee ae prow “ss. 
= gram impTementation (@.g.; test. development . -in-other states, such as. 

New Hampshire, gocal districts are required fo-carry out many; of these 


tasks. Nonetheless’, in both cases, local-districts, must infttate minimum 
competency testing. ee ee eee ee ae 
By comparison, a different type of mandate was.issued in Idaho and“ or 
Illinois; both af these states having*district-optton. programs. In [daho, ga 
the State Departient of Eduoation hasdeveloped a program of: proficiency io . 
testing in which Voggd. distetcts. are trstedste pantleipater chase We ean ees 
participate are, then*subject to state.requirementa.. In: I} linois, the:- 42 peer eS 
State Department of Education: provides technica] assistance. to.those Weal 82. G8 
_ districts which voluptar ty decide ta adopt’ miniinum competency: testing... ooo as 
' ; ; : a! 7 . tS ; cA 7 7 es a “Goa ee 7 - a oa me ape . 
hae Still a third type of mandate was issdedin Kansas and-Magge where | 
legislation has required testing only on. a temporary basis. UfKangas, &@. 0 6 we: 
os. twoeyear pilot program of conipeténcy-based education andmtnimum compe~ se 
tency testing was mandated. At the end of the two years, the legishature (ot, 2 


will decide whether to continue the. program.< In, aime, acone-time state- — | 
wide assessment waS legistated, partly for the purpose. of developing Gom- 
petencies which could be used far graduation requirements > Following-thd «- > = 
assessment, however, ongoing activity fas focused on a planning process to. ~ Sak 
assist ldcal districts in setting educational. goals, objectives, and per- ocr oo, 
~ formance standards; MCT may or may not become apart of this-process in the wis re 


future.. > 
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| ~ Responsibility for. taittay Mandate ie a 
e eating, for State: MCT ita a ‘3 
. i ve 
a — aos a - , . - 3 ee 
ae ate Board of Education State Legislature 
ie ee nthe ae oe at. ee ee ee 
‘AYabama | - epee ; 
Delaware - California” 
-* Georgia Connecticdt 
os e " Idatto ae ps Florida 
Maryland “11 1inois 
* % Massachusetts Kansas * = 
; Missouri . "Kentucky. 
Nebraska - oT “LSyist ana : 
. New Hampshire Maine 
"New Mexico Michi gan® 
New York: (f 02) _. New Jersey 
‘ Oregon Nevada’ 
7 ‘Rhode Island” North Carolina 
=; Tennessee South Carolina 
"Utah . Virginia 
‘Vermont (1979: Texas) 
. —_ eS eee 
“1 prizona: competency-based* program initiated m1 legtelative + man-. 
fe -- date and directed: by, SBE mandate 
* 2 Michigan: legislative mandate for assessment in: grades 4 and 7, 
= 4 SBE mandate for. assessment in grade--10 - 
3 Nevada: legislative. acti on mupenectey SBE Action, 
ys. 
~4e ; 
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2? ie, varies. 3 a 
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| Of the 20 local district fwograms, four were initiated as the result 
of a State Board of Education mandate and three as the result, ‘of state. _ 
..... legislation. Five. programs developed entirely.as a‘result.of..local. initi- 9 
+ cative'tn states without MCT requirements of any kind; in states with MCT 
Bei tg alban foe rau ea eran MA laa their own programs either 
before or in addition to the state program, The methods by which all of”. 
these local programs were initiated. are summarized in Table 3. oa 


For the most part, it is the public school system that is affected by 
+ both the state and local mandates.. In both Connecticut and North Carolina, 
however, _nonpublic schools were originally subject to the same provisions: 


of the law as public schools. - As a result of receft legislative action, | 
North Carolina nonpublic schools now participate in the state minimum com- 
petency program dn a-stfictly voluntary basis. © - ; 2 * 

( : ; a oad 


x e 


Phase of implementation. The majority of the minimum competency - 
testing programs under study--over two-thirds. of the state programs and — 
three-fifths of the local district programs--have been initiated within: 
the last three years. Table 4 lists the.staté. and local programs that 


have been,in existence for less than a year, for one to five years, or for. 
five years or more. A few A ges * initiated in the early 1970/s, 


Michigan and Geérgia began their pro s~in 1969, and the Denver, Colorado 
. program, the oldest one of all, has Been in existence for over 18 years. 


Of the 3i:state programs, only 14 are fully implemented. The remain- 
ing states are field-testing, or phasing,in graduation requirements and/or 
_- Gurrtculum charges over the next few years. Some, like New Hampshire,. 
. require djstricts to complete all steps in program development within a 
. certain period (e.g., five years), but districts determine. when each indi- 
vidual, step will be completed. Thirteen local programs are fully imple-- 
mented, while seven .are phasing in some or all aspects of their programs. 
AS.a result of phasing-in.programs, many states and districts have not yet: 
formulated procedures for, for example, standard setting or scoring and 
aoalysis. , es _ 


, OD sciices litlest ten, Although many states and local districts 
anticipate legal actipn as a result, of minimum competency testing and 
remediation programs, only four of the states under, study have had suits 
brought against them: Florida, North Carolina, Delaware, and Virginia. 


-- Florida has so far had four cases brought against the state as a 
result of the minimum competency program. The first case involved the 
State Student Assessment Test, Part II (SSAT-II), which is the Functional 

_ Literacy. Test administered to eleventh-graders as part of their graduation 


» 


. Nae Hep ¥ me a x ae ‘ AMS 
a . . * oe. — 
Re in eas aS ee Gen _* L : eau 
ee oe ae aaa a ee i a Dr nn ee ie tee ie Ee al see Se 


y i SA ae 
- < a TNBLET 3 


Responsibility for Initiation of Local District MCT Prograns 
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Local Initiative | Local Initiative : ; = ‘ 7 tee ie? 2 A 
in States without. in States with ‘ ee | 
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State MCT as “| State MCT Pragrans : ee ae P< | pee 


Gary, IN | Omaha, NEB. Santa Clara, CA. | Salem, GR 
- yOrange County; VA |. Parkrose, OR -. 


Denver, co 8 = Lawton, mh. | ae: 

Rocky River, OH “Detroit, MIL - =], HAN Isborough, °FL S. Burlington, VT gf} 

Bettendorf, JA Fitchburg, MAe he | | | Thomas County, GA - 
|. Kanawha County, WV. -| Houston, Tx3 | | 


‘Char}o te-Heck |enburg, 
NC 


ConVal, NH? 
Columbus, Ks3 


‘respective state programs. % os 
eloped in response to. state requirements. 
prior to issuing of state mandate but meets state requirements. 
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TABLE 4 
‘ = Length of Time State and Local ACT Programs ’Weve Been In Existence ( , 44 21 he 


+ 1-5. YEARS 
(1979 = 1975) 


+ 1, YEAR OR LESS 
(1979 - 1978) 


_ STATE ~ 
" Contecticut Houston, TK Alabama Santa Clara, CA ~ 7 Arizona Denver, CO 
iMinots Orange County, VA | California |} tsborpugh, FL Qelaware ** | Gary, HOO 
 Kangas | i ar Idaho _" -T Thomas County, 6A. Ftorida | Lawton, MI 
, Kentucky 7 ; % Louisiana _ | Bettendorf, 1A Gedrgia f° Omaha, NE. 
Maine i ae Nebraska ‘Columbus, KS "Maryland Satem, OR 
Massachusetts J  Wevada detroit, MI Michigan "| Port dand, OR 
Missourd | 7 New Hampshire Conval, WHO ‘Qregon =| SF Atchburg, MA 
Rhode Island | New Jersey Char-Mecklenburg, NC, a 
South Carolina New Mexico -. Rocky River, OH. , 4 ; 
7 New York .$. Burlington, YI 7 
‘North Carolina Kanawha County, WV. 
o 7 “Temessee - . 
’ “Utah. . 7 ae 
Vermont. : 7 , _ i s ‘ 
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... frequirement. In October 1978 a class action suit was filed in the Tampa... 
a . Division of the U.S. District Court on behalf of three classes of plain- \ . , 4 
coves hi ffs. all-presént..andfuture. twelfth-graders in Florida. blic schools J oe. 
an “eho: have’ fai ad- and: would continue to fai] tHe SSAT-II;. all present. and. 

future black students: in the @ame ‘schools who have failed and would con- - 

tinue to fail ti SSAT-II; and all present and future black twelfth-graders 

in ee ne County who. have failed and would continue to fail the ‘ - es 
SSAT-II.° Defendents named in thé case included the Commiggioner of Educa- as 
tion, the, Governor; and the Department of Education. eae ce Ae 


eee The plaintiffs advanced_a number’ of claims, including that the test ( 
| was racially biased, that the plaintiffs were gtven neither adequate == © 
notite nor adequate preparation time, and that. on ret the. SSAT-II to | 
classify and group studénts in need of remediation regmstituted = 
segregation in the public schools. = r. eo tg: 


In & ruling handed down in July 1979,-thd Court found the "schedule . 
for the implementation of... . [the Functional Literacy) Test. to beja | 
violation of the due proces? clause of the Fourteenth Amendment . . ." and 
that "Until the 1982-83 school year, . . . Crequiring that a student pass 
the SSAT-II to recetve a diploma] is a violation of the equal protection | 

clause of the Fourteenth Anendnent . ..." (Debr’a P. v. Turlington, 1979, | 

- p. 2). AS a result, the Court, although permitting epartment to 
continue to administer the test, enjoined the state fro ftnstituting the\ 
SSAT~EI as a graduation requirement until the 1982-83 school year. 
: a 


; ‘ : : “oN 
With respect to the other claims, the Court declared that the test 
, itself ". ., has adequate content validity . . . and adequate construct = 
validity". (Debra P. v. Turlington, 1979,.p. 30). In addition, the Court 9 ow | 
ae declared itself aot convinced by the Plaintiffs' evidence that the test 
or any item should be invalidated for racial or ethnic bias". (Debra P. Veg OU lg. 
Turlington, 1979, p. 30). Finally, in examining the claim that the pro- -, ae 
gram served to Yeintroduce segregation.in, public ‘schools as a consequence : 
of instituting’remedial classes, the Court admitted that while the compen- 
-» §atory education program "is disproportionately composed of byack children 
— _-, . thus far the record is.clear that.the purpose of the:. 4 . [remedial 
program ] is to assist students and not td resegregate them" (Debra P. v. 
- Turlington, 1979, p. 45). Thus, the Court found utilizationjof the results 
of the SSAT-LI as a mechanism for remediation to be "neither! a constitu- 
| cere nor a statutory violation . . ." (Debra P. v. Turltngton, 1979, 
0. a i, Sa —A- 


In another Florida case, the NAACP has contested the right of the 


e « Department of Education to limit public accéss to the SSAT-II. . The NAACP 
did not prosecute the case, and it has since been dropped. -_ 
- ; = , > a 
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Ina third’ case; Brady:v, Turlington, a Florfda resident contended: 
under the administrative Procedures Act that the Commissioner lacked the 
_ authority to establish scoring criteria. At the first hearing, the 
officer ruted in favor‘of the plaintiff. In.an appeal filed by the State, 
the District Court of Appeals subsequently upheld the authority of the 
Commissioner. - | we ON 2, Oe an 


a 
an 4 


- A fourth chaTlenge, Brady and Blount v. Turlington, also involved the 
scoring criteria. In this case, the plaintitts sought, under the Adminis- 
trative Procedures Act, ,to have the scoring procedures used in the 1977-78 

__ Statewide assessment declared invalid. The ruling favored this petition . 
~~. on the grounds that. the prep “eS 
: scoring procedures had not been followed. THe District Court of Appeals 
‘ subsequently upheld an appeal filed by the Department-of Education and — 
declared that the correct ‘procedures had Been followed. ae 


 In.Delaware, the State Board of Education was sued by a Wilmington 
newspaper seeking the release of test results. The suit was settled out 
of court and the statewide resulte were- released, to the newspapers. 


North Carolina has had two suits filed against it because its law,. 
which requires minimum competency testing by means of a nationally stan- 
dardized test, and then.reports of the results to the State Department of 
Education, “Li ae aL to public schools but to non-public and 
private religious schools as well. The State was sued by the Southern 
Christian Leadership Council on the grounds that the. Taw violated equal 
protection laws. The case (Green v. Hunt.) was dismissed... The State was 
‘alsa sued by the Christian schools, who claimed that thein First Amendment 
right to privacy was violated by the law. “The State filed a counte claim | 
ordering compHiance with the law. Subsequent litigation, however, makes 
compl{ance with this law a voluntary matter for the nonpublic. and public 
schoolse st —_— 7 : 

The Virginia Department. of Education was sued by the Richmond News 
Leader in 1979 for the release of the graduation competency test. The © 
newspaper won. the case, and tests are now released by the Department of | 
Education. The Virginia General Assembly amended the Freedom of Informa- 

tion Act to require the release of tests within six months of the test 


administration. | . ! = 
\ oar , : , : 
| : ia 
\ a 
; -10- % . 
. 7 y : 
. . 19° 


e ie i eC eee a ae vices neagence 


a oe 


er administrative procedures for determining .. - 


fey 


4 
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| Gendral goals, Of the general goals cited by state and local person-- 
nel in explaining why minimum competency testing was adopted, four common | 
ee ee ee personne?’ reported that such programs were .a way 
ng 


school education, #Finally a fourth goa} cited gy program personnel was to 


allow fon earlier “identification of students in need of remediation in 
critical skills. - +t . a * 


4 


) Specific purposes. These four generad goals amarefTected in the 
specific purposes cited by program personnel. In attemmting to introduce 


vi 


- accountability and ensure that all students master certain essential. 


—. $kills, many state and local programs have tied the mastery of competen- 


high school... 


@ 


‘viewing minimum competericy testing“as a means o 


of minimum competency in o 


- the broad competency areas for assessment, while leav 


ties to high school graduation. and/or ape ae Ne ba A te In 
clarifying community 
expectations regarding education many programs cited curriculum change as. 
a specific purpose. Finally, for those who saw MCT programs as a way to 
identify students in need of remediation at an early stage, specific ‘pro- 
gram purposes included requiring that all ‘districts provide the remedia-. 


tion. In Table 5 state programs are sae baa according to the specific ° 


purposes expressed by program personnel; 


n Table 6 local district pro- 
grams are similarly categorized, 


As shown in Table.5, 14 Af the 31 state programs currently require, 
or dn their original planni schedule intended to requtre, some measuré ~. 
or more subject areas: for high school gradua-— 


tion. For only five state programs-is the requirement {n effect now; for 
the remainder, targeted implementation dates for the requirement range — 
from 1980 to 1983. Oregon, while included in.this ai tae mandates only 


how assessment might be linked to graduation up to the local school dis- . 


‘triets. Arizona, too, emphasizes local’ autonomy, and requires that stu- 


wr 


ng decisions as to 


dents demonstrate a ninth-grade reading ability prior to graduation from 


a 


ae a 


ae 
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oe 2 ad oe Expressed Goals and Purposes of State Programs | 


. ~- . t Grade Promotion! Redediation Curriculum Change 
‘Diploma Tied to Con~ Use of Attendance Special Recognition Alternate Routes ; a ; oe oir 
peeency Achievement Certificates on pipiens: to, D1 vice ae 
7 aime . Florida “Idaho (atate’ Mary) and : Arizona, . |. California fonagticut 
Caltfornia-1980 , ABeorgia: under seal _ Ne York, Nevada Connecticut. el aware 
Del aware-196} ‘cons {der at4on) Ea New Mexico" North Carolina a) #4 _ Florida Georgia. :, 
‘Flerida-1963 North CaroMina | - 3 . ae ie Georgia .,) fiestehasette, 
Georgia~1983  . “Utah . oe idaho eryhand 
Maryland ys “hettechy. Y Nebetske 
’ Nevada- 1982 * . Wes rik thas a New -Hampshtre: 
vNew York cs 7 Nie igan ’ Wew Jersey FS 
_ North Garoltna . ay a Missouri New Mexico 4 
‘Oregon ° : -Webraska. Wrointa : 
‘Tennassee- 1962 . New Jersey 
- Utah - a , ye , New Mexico 
Vermont-1981 : “|. Mew York - { 
Virginia-1981- . : Nevada : js 
7 North Carolina 
‘ 7 South Carolina 
r _~ _-* | —. Tennessee 
: . * Utah — 
o . Virginia 
1 4 


Competency achievement is only one of. the criteria for grade promotion, not the sole alae 
¢ Reading achievement only, in addition to credit requirements. e 
3 Hondaved broad: competency areas for graduation onlf all dec istons apout - how assessment 1s to be linked to graduation are made by locat*aistricts. 
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| Cure teu lum Change |. 


Diplowa Thed to. Com- 


2 . Use_of Attendance 
3 petency Achievement 


Alternate Routes. |. 
‘Certificates : 


to Diploma 


Bat tendorf he. ouiion . Columbus , Conve} . charlotte-neck enburg ee ‘Columbus 
Kanawhe ; _ Columbus Columbus - 3 Detroit: 
+ ( Thomas Count y)2 = Houston? Detro{t:. . Houston 
D bani ; | 7 7 Lawton es Kanawha . 
Detroit-198} uw eee | wy Lewton |. 
_ Bary ee . aes wn sborough Orange County 
_| Ht lisborough- 1983 y se, Houston J Tnonas County 
Lawton- 198 7 ss T Kanawha 
Omaha oe Me ST bawton 
Orange County to # é ; ; “4 Orange County 
Parkrose’. a ice 7 nS Senta Clera- 
Rocky Ri yer-1962 * ‘ : : ; . 
Sal em-1980 im : 
‘Santa Clara-1980 
5. Bur lington-1961 . 
‘Thomas Count y- 1983 , 
| Competency achievement {s only one of the criteria for “grade promotion, | not the sole eriter ton. —_ _ ee “ _f : 
Planning to develop a performance profile to accompany the diploma. oes P nea os ee 
3 Midyear promotion is baged on a number of factors, of “se scores wes one. ve . ; : as 4a | : 
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ee “ln cnrae of the 14 stiles that tie somnetency achievement to a high 
| chao! diploma, students receive a certificate-of attendance if they do — 


“not. haster the- ereerene At present Georgia is. orn a. similar ~ 
prviers., A: | 


» y , Idaho, and New eves: rather: than making the Kigh school ee 
contingent upon compatency tests, provide special recognition’ on the 

. diploma for competency achievement. Idaho, furthermore, has a district- 
. option proficiency testing program, 1.@., a program offered to as tricrs 
$9 on a nS Nekd voluntary basis. . 1. ‘ 


\ 


dipfoma. A student in New York, for "example, can pass regular Regents 
exams and/or achieve an acceptable score on a standardized college admis= 
Sion. examination in tiew of passing the Regents Competency Test. 


Test results are taken into account in determining grade promotion 
- for all or some of the elementary grades. It is important to note, how- 
ever, that in no tase do test results alone determine decisions about 
ao grade promotion. 


‘Ten states cite curriculum changes as deeeecieic purpose behind. pro-. 
gram implementation; test results are used along with other information to 
determine areas” of WEAKNESS vo oo 

Nineteen states report that remediation is- a “specific purpose of 
i their. minimum competency testing programs. In some states, the mandate 
ae ae TocaT districts to provtde remediation; while in others , dis- 
. tricts may decide what provisions, if any, regarding remediation. to make. 
Table 7 lists both the state and “local programs which have provisions 
are pecifying whether remediation is optional or mandatory. In nine states 
- | ee is mandatory, while in 16 states it is apevenets 


- By contrast with the state programs , ‘a: higher number “of local dis-- 
trict programs tie competency testing to the award of.a high school 
diploma (see Table 6). Altogether, 16 out of the 20 local programs. 
require, or will require by 1983,- that students achieve competency in 

certain Skills prior to graduation from high school.” Of these 16 local 
programs, seven are.in states with a mandated graduation requirement. If : 
. we-axciude these seven, then it is the case that nine out of 20 local dis- 
. programs have independent 1y linked the results of a minimum compe- | 
os tency\test to graduation. Three local programs--Houston, Kanawha County, 
and T Im as Count y--either award special.certificates of competency to those 
“demonstrating competency achievement or are considering’such a 
ity. One district, Bettendorf, awards certificates of | attendance 


a 


+ In some ‘programs, 11ke New: ‘York, ‘there are “alternative youtes. ‘to a a 


“cadifornia a ra CA, “Alabé Bettendorf, IA 
Connecti gut | ) - | 5 Georgia |] Fitehburg, MA | 
Florida J 4 ) - WNinods Char lotte-Meck Tenburg, nC. 
Maryland a he ‘ Kansas . ae Thomas County, GA 
New Jersey Lo Kentucky S$, Burlington, YT 
New Mexicd o Oe “Maine 4 Kanawha County, WV 
New York | A Massachusetts : 8 
North Carolina ph ~  MIchigan | 
South Carolina . - Corival, . > Missouri 
Viegints Rocky River, OH Nebraska 
‘Nevada’ 
Oregon 
Houston, TX = Tenness 
Orange County, VA _|- 
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to students who fail the competency test, while in one district, Columbus, 
Kansas, passing the competency test is considered as an alternative route 


to..a diploma. . 

7 With respect to other specific purposes cited in programs, four local. 
programs (Orange County, Lawton, ConVal, Columbus) use the test results as. 
only one of. the criteria for determining grade promotion. Again, as noted | 

.~ above, in no case do test results alone determine decisions about grade ~~ 

‘ promotion. | - 3 , | i 


Competencies, Target Groups, “and Testing Schedules 


Summarized in Tables 8 and 9 are the numbers of programs that assess 
the various competency areas and the grade levels at which these areas are 
tested. In general, most programs emphasize the achievement of Basic, 
academic skills, but many also focus on the instruction and assessment of 
-these-skills-in-life-context. situations. Several programs test for both 
kinds of skills, and-a few test essentially academte-skills.in_the lower 
grades and more applied, life-context skills in the upper grades: In _ 
Rocky River, Ohio, thére is no competency test for life skills, but the 
district is beginning a mandatory course in life competency skills. 


All programs have developed.competencies in reading and mathematics. 
Twenty-seven state programs and 15 local district programs also test Tan-. 
guage arts and/or writing. A few programs have developed listening and 
speaking competencies; some have. chosen history, government, and economics 
as important subjects to test. Only one program, that of Orange County, - 
Virginia, has a series of tests specifically for science. ‘In Georgia and 
in Thomas county the local dist®ict studied in Georgia, the focus of the 
program is on | fe skills; the competencies are not categorized {into typi- 
cal subject area objectives, even though the competencies do, in fact, 
include skills in many of the traditional subject areas. Instead, they 
are grouped into the following categories: the Learner, the Individual, 

the Consumer, the Citizen, and the Producer. — Be’, = 


Reading: 


“Speaking  @ 


TABLE 8 


Mathematics | 
Language Arts) 


i 
jt 


Writing 


Listening: =} 


Other (e.9., demo- 
cratic pracess, 
consumer @conomics, 
science) | 


eo 
' 


uh 


Number of Programs Assessing’ 
Various Competency Areas ~~ 


' | ase oe ; a ; : ois, : : ‘ 4 
Ke r a - ; / . aq 
TABLE 9 aoe: at 
ee Competency Areas and Grade Levels: Assessed : : se i : 
N 2 ; 
p's Competency 
Area: . 
Other (e.9., demd- 
_cratic process 
science. 
as | . 
: | —@ In five state programs, decisions regarding what: grades to test are left entirely to local districts. _ 
~ @ In two districts, teachers decide whan certain competencies ore to be tested. — é : 
. . , e | a ° 
7 : i “he 
a | 
a 48% hee ch é 


_ + About two-thirds of, both the state and local programs test competen- 


—cfes at. both the elementary agd high school levels. Six state and six 
loca] programs test only at the “secondary Jevel. (Note that Table 9 does” 
not reflect thts fact, stnce a/few local programs-test only reading and* - 
mathematics at the ae school? level, but include other areas at. other 
grade levels..) For almost av] of these programs, the high school test is 
required for graduation. Of the programs that require a minimum compe- 
tency test for graduation, most test inthe tenth or eleventh grade, and 
‘some-as early as the eighth or ninth grade, to ensure ample time for 
remediation and for seVeral other opportunities to administer the test 
before graduation. © —— a a 
Perennial Stine mani wiNl cates Mes ene ene fe att eet Sees oe Ste at eee ae seis Seka ae eee 
; In five states (Illinois, Nebraska, Vermont, Arizona, and Oregon), 
the test schedule is not specified. In these programs, local districts 
and schools decide when a student is to be tested for achievement of 
particular competencies and when that student is to be retested. At the 
local district level, two: sites permit teachers to decide when certain... 
— com- petencies will be. tested. In South Burlington, Vermont, for example, 
la - test a competency when the student is demonstrating mastery 
of it.* - ao 7 


With respect to competency development, in about two-thirds of the 
staté programs the competencies for all grade levels have been developed 
by the state. _In’Massachusetts* and Tennessee, the state determines the 
competencies which are to be tested-at the secondary level; these states 

,.. also mandate competency assessment at the elementary level, but leave “the 
4 responsibility. for developing those competencies to the local districts. 
| In afew states, local districts are free to decide which competencies are | 
ph to be tested. In some cases these decisions are closely monitored by the . 
-. State Department of ‘Education, and in othets the state provides a printed 
<. guide and/or workshops to help the local ‘districts set up their programs. 
In some instances the grade jJevels to be tested are mandated by the state 
“< - but tfe “competencies are the option of the local districts. Most of the 
| local district programs includ@d in the study have developed their own | 
competencies. = 


“Standards and Standard Setting | 


ra 


Standard levels of performance on MCTs in the various programs are. 
generally set by the state if the state is also responsible for devel- 
oping thee competencies, and by local districts if the responsibility for 
competency development lies with the local district. In some cases, ~ 
states require the local districts to set the performance standards. 


; : : ‘ . ww 
as : . _ 
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- @nly two programs set standards for the total test. In most other =, 
programs standards are set for each competency, and/or the major subject 

areas‘rather than for specific competencies within those subject areas. 
- Some of the newer. pregrams- have- not. yet. established either.standards.or 

the procedures for setting them. ae 
‘ P » * 7 _ * 
Listed in Table 10 are state and local programs using various methods 
for setting performance standards. Some programs are described as setting 
standards by administrative decision because they gave no rationale during/ - 
the site visits for the standards they pted.. Also important.to note ig 
; the fact that utilizing field-test data to set a standard or identifying 
"_____....gtandards..as-inherent—in-the_definition_of the_competencies are process 
which may overlap the other three procedrues listed. The programs note 
under these categories may have, for example, set standards by administra-, 
tive decision, Nedelsky, or contrasting groups. in their use of field-fest 
data. This was not, however, specified as such during the site: visits; 
only the fact that they used field-test data was indicated. 


Two local programs--Detroit, Michigan and Thomas County, Georgia-- 
have not yet determined what method to use for setting standards. Of those 
which have established standards, seven based them on field test or test 
administration data, three used cealhatie pen groups, one used the Nedelsky ~ 
method, one used a combination of the Nedelsky and Angoff methods, and six 
set standards by administrative decision. Omaha, Nebraska; Gary, Indiana; 
and ConVal, New Hampshire are examples of programs listed under-more than 
one method, since in each case different methods were used for different 
tests or sets of competencies. .The South Burlington,’ Vermont program is 
an example of one in which the standards (ranging from 80-100% accuracy 
depending on whether a competency tests a fact or a process) are built 
into the competencies. Fitchburg, Massachusetts, not included in the 
table#is a program in which the teachers make the; decisions, on the basis 
of both stiident test scores and their own judgment, as to whether students 


_ have demonstrated master y of the requisite competencies. «+ — 
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4 ae 
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" a TABLE 10 | 
A _ Procedurés Used in Setting Standards. © °° er ee rene 
> ; a : ; ; . : r 4 - 
ey / 
= Administrative Decision ‘Arizonal ———t—ié‘dt mana NE ee 7 
4 Michigan 
M4ssour{ a ee 
és ‘Nevada | y eo f a ae 
, Tennessee? Char lotte-Mecklenburg, AC 7 4 
7 7 Orange County, VA a. ee 
s 3 . + ¥ 
: By Contrasting Groups Kentucky 
‘. e3 . North Carolina. 
: “Bettendorf, IA 
. ub is : 
’ a . . : 
New Jersey Kanawha Sounty wy oe 
Z ee Rocky River, OH . - 4 
Using Field Test Results Alabama Columbus, KS 
and/or Othgr Statistical, Florida | Denver, CO = 
Procedures ~ 3 Georgia | HiT sboroygh, FL 
Idaho Crmaha, NEY: 
Maryland . Portland, OR 
New Mexico Salem, OR 
New York . ; Santa Clara, CA 
South Carolina 
Virginia 
By Competency Defini- Delaware. Ss. Bur ington, VT 
tion > Nebraska ConVal, NH 
Vermont 
h -s . 
5 . ‘ F 
1 Overall standard only; local districts set specific, individual standards. 
2 On eighth-grade test only; no standards set for. eleventh grade test. 
” 3 Procedures for setting standards varied by test or set of competencies. , i 
Not true standard setting procedures; first three procedures may have been used in % 
latter two categories. : 
ee : 
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a . _ ‘Breakdown of State Prograns in Which Standards ' 
—_ | | | Have Not Been Set 


~~" bocal District Option 
: or Decision 


California. Kansas 
Illinois “Maine=« 
Massachusetts 
.New Hampshire 
oe » Onegen’ 


Utah 


=f 


of 


. “Kt 


MCTUndab Study; 


No Standards Set _ at acater Date i 


Standards to be Set 


Connecticut. — = ae 
| Louisiana | 


Rhode Island 


2 


we oe f- Humber—of- patperns. have. emerged forthe distribution ofthe. respone. ooo... Ss 
sibility for develop 


"Test Instrumeits 


¢ 


Be eccone ny thisstask. See Table 12 for a classiftcation of state ° 
programs according to whether the state or local districts assume or share 
responsibility for test development. In seven gf the state-level programs, | 


~ the states delegate complete responsibility for the choice of test instru- 
-ments to the local districts. In tha California, Oregon, and Illinois 


state's, but t 


Tek aie for example, local districts may develop or select tests to suit 


thelr—own—populations.-The-states_provide-technical—assistance,but—local______ 


eas are not required. to obtain state approval for their test instru- 
ments. | . 7 _ . 


“In 14 other state programs, local districts must utilize the tests 
developed or selected by the state. In these states, such as Florida, + 
North Carolina, Michigan, and Nevada, local districts ‘are not precluded | | 
from ae oie own programs in addition to and independent of the » 

y must comply with all requirements of the. state program. | 


‘In the remaining eight state-level programs, the local districts share 


“decision-making responsibilities with the state agency to a greater or. 


lesser degree. Sev@ral programs, including those in Virginia, Tennessee, 


_ and Connecticut, require local districts to administer one or more state 


tests at the secondary level but permit the districts to choose their own 


‘ instruments for assessment: at the elementary level. In other programs, 


such as those in Nebraska. and, Massachusetts, the state has developed its 
own instruments which it ‘offers to the local districts as one option for 
assessment. In the case of Massachusetts, local districts that choose not. 


to use the state-developed, secondar y-level instruments must either select 
_ one from. a sta@te-approved list or obtain approval for the test instruments 


they desire to use. 


Maine and Kansas are exceptions to all of the above patterns in that 
they do not have permanently implemented programs. Maine conducted a one- 


time statewide assessment and is now engaged in an educat 'ona | plaon ing 
process, and Kansas is conducting a pilot program that may or may not ead 


to-a decision to implement a daa competency testing eT eee Devel-. 


state. 


~ Togal disgrict has develo 


opment of the tests in both states, however, was the responsibility of the 


In almost all of the local district programs studied, the district © 
took on the responsibility for developing at least a part of the test 
fnstrument used in the te fing program. In Orange County, Virginia, the 

d its. own tests for reading and for, graduation 
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seep oe = —. Responsibtlity for Test Development sitet ne 


- “ee 


~ Comp lete Responsibility Responsibility Shared 


Comp tete Responsibility 
| _ LEAS 


__Assumed by SEA,. | by SEA & LEA 


_ Arizona” 
California 
- [)inots — 
- New Hampshire - 
Oregon 


Alabama 
Florida 
Georgia 
Idaho 
Louisiana 


Connecticut 

Delaware 
Kentucky 
Massachusetts 

- Missourd 


Maryland Nebraska Utah 
Michigan Tennessee Vermont 
Nevada | Virginia | ‘ 


New Jersey 
New Mexico: 
a New York | ; 
me North Carolina 
a 7 Rhode Island 
NS South Carolina 
: —] 


| 


See : 
XV ony an 


1d Kansas are omitted; s @ page’ 22: far explanation. 
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—@ Maine ¥ 
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. competency, but: uses the State-developed test instrument for mathematics. "? 
Sone of the instruments in use at the local district level (1.@., South” 


"> by processes which have served: as models 


Burlington, Vermont and Contoocook Valley, New Hampshire) weré developed one 

“for the state-level programs-now----- 
under development. + gs _— “ee 
7 | 


_ Displayed in Table 13 are ‘the programs catagorized according to 
what particular methods of test development. and/or selection they are. ao 


using. Listed in the table are those states which assume all or some of Bee 


-the responsibility for instrument development as wall as the 20 local ‘— = F 
districts. In the programs studied,-instruments were either developed Hess 


in=house-or-with-the-help-of-outside-consultants—(e.g.,-a-consulting- f4rm)-——— eee 
or were selected: from among cammercially available ones.” Also, some state 
and local progi™ms elected to combine these options. — : 


“Of the 22 state programs listed, almost half (10) chose to pursue a 
single method for obtaining instruments. Ttiree states developed their own 
tests in-house, while four elected to utiltze outside consultants for test 


development. Three states selected a commercially available instrument, — 


either as is or tailorad-by the publisher to the specific needs of the 
state. Of the remaining 12 states that chose to combine these. procedures, 


six states developed instruments both in-house and through services pro- 


vided by outside consultants. Two states developed tests in-house and 
selected commercially available instruments, while one (Virginia) elected 
both to use commercial instruments and to utilize consulting services to 


develop instruments. Finally, three.states used-all. three methods for 


obtaining their test instruments. . In the case of Nevada, for example, — - 
commercial. tests. were selected for use at the elementary levels, and — 


teachers, with the assistance of outside consultants, developed the tests 
to be used at the secondary level. — “4 sg 


Of the 20 local programs, five have developed instruments in-house, 
and, the sane number have selected existing instruments. Six districts 
have developed tests both in-house and through services provided by 
outside consultants or agencies. oe 


‘Some of. the competency tests used by Hillsborough County, Florida and 
Omaha, Nebraska were developed in-house and some are commercial tests. 
Omaha, for example, uses the Gates-McGinitie reading test as #ts compe- —. 
tency test in that area. Gary, Indiana is the only local program in which 


some of the competency tests were developed fn-house,.one was developed — 


under contract to Westinghouse Learning Corporation and one is a ait a 
cially available test.. Finally, theré were no local programs that utif- 
ized only consulting services for test development or who chose to use a 
combination of cqnsulting services and commercial: tests. 3 
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: In-House Deve lopment: only “Michigan Char lotte-Mecklenburg, NC 
; Missouri Columbus, KS. a _ 
\ Nebraska Fitehbur . MA 
alem 


S.: Burlington, ue 


Use of Contul ting Connecticut* 

Services or Contracting Maryland 

Agency on New Jersey 
. Tennessee* 


dy Bettendorf, IA 
* Oenver, CO 

Houston, TX | 
Lawton 


Rocky River, OH 


Del aware* 
Kentucky 
* North ‘Carolina 


Use of Co 
and/or Tests Tailored 
by the Publisher only ¥ 


ConVal, NH ‘ 
Detroit, MI 
Kanawha, WV 
- Orange County, VA 
Parkrose, OR 
Santa Clara, CA 


In-House Development Alabama 
and Use of Fonsulting 


Services or| Contractor 


New Mexico 
South Carolina 


Hi 11 sbordugh, Ft 
Omaha, NE - 
Thomas Count PGA 


In-House Development 
and Use of Commercial 
or Tailored Tests 


_ Use of Consulting 
Services or Contractor 
and Use of Commercial 
_ or Tatlored Tests 


Virginia 


Massachusetts 
Nevada °¢ 
Rhode Island 


In-House Development 
and Use 6f Consulting 
Services or Contractor 
and Use of Commercial 
‘or Tailored Tests 


* at one (grade) Tevel si ; SY 
: ™— 


e Omitted ‘are the following seven states which oe legete responsibility for test devel-. 
opment entirely to local districts: Arizona, California, I1linois, New Hampshire, 
Oregon, Utah, Vermont. ; 


e Maine “and Kansas, as “one-time pilat studies, are also omitted. 
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are the Senior High “Assessment of Reading Performance (SHARP), the Test of 
‘Proficiency in lp Skills (TOPICS), and the California Test of =” 


No one commercial test is used more than others. Among those: chosen 


‘Basic Skills (CTBS) published by CBT/McGraw=Hill;-Gates«McGinitte Reading: “os so 2 


Tests: Survey F published by Teachers College Press; the Beckman-Beal 
Mathematical Competencies Tests for Enlightened Citizens; the SOBAR read- 
ing test put out by Science Research Associates; various tests publ tened. 
‘by Stanford Research Associates; the Adult Performance Level test published 
by American College Tastings and the Jowa-Tests of Basic Skills (ITBS) °: 
published by Houghton-Miff 1n Company. 


———————— Although mos tof the tésting- programs-use-a-multiple-chotce format——-- 
- for at Jeastspart of their testing, a large number require writing sanples 
at various grade levels and a few require students to give some sort of 
oral presentation. Part of the Salem, Oregon writing test requires stu- 
dents to summarize a passage. Most tests are not timed, but in a few 
. programs some sections of a test (e.g., in addition and multiplication) 
may be timed. The N-ABELS, in the Nebraska program, is one of the féw 
assessments that is entirely performance-based. For various parts of the 
test, students are required to read aloud, locate words in-a dictionary, 
and locate a topic and cross-reference in a card catalog. Among other 
districts which employ performance-based tests of skills are ConVal, New 
Hampshire, and Sout® Burlington, Vermont. In the former, students are 
tested on such skills as answering a phone and taking messages, writing 
business letters, and giving oral présentations.. In South urtington, 
Vermont students are asked to complete common forms, to participate in a 
discussion, to give directions and to make various measurements'(e.g., 
mass, length). : “eS 


’ 


Test Administration. 


> Testsadministration for all of the programs. under study is handled at 

‘the local district level.-. While states may prepare manuals to assist test 
administrators, in all cases local personnel are responsible for this 

task. Typically, classroom teachers administer the tests in the elemen- 
tary grades; counselors, teachers, and administrators administer them in 
secondary grades. In Gary, Indiana, it was found that teachers were 
assisting their students; therefore, classroom teachers no longer admin- 
ister tests to their own students. Contoocook Valley, New Hampshire has: 
a specially trained team (COMPASS) which is responsible for administering 
the tests. _ —— 


‘ . : - . : i , . oo 
ERIC eee, | —_ 


Se ee 
+ South Burlington, Vermont has developed a unique system for adminis- 

tering and. scoring the competency assessments at the junior and senior 
high. school levels. In their system of "mentor groups," the mentors, or 

-- assessment administrators, consist of. both classroom teachers. and school 
‘administrators, Each megtor is assigned approximately 16 students from 
all grades, and the groups meet once a week. A student is to be a.member 
of the same groyp ‘throdghout middle and high school years, thus giving. ° 
each student the gpportunity to establish an ongoing relatfonship’ with a 
faculty member. The mentor is responsible for assessing al] the students © 
in the basic comBetencies they are expected to have mastered at their 
grade level, and also for retesting to ensure that students have main- 


+... -bained—thedr-sk4115.—The-mentor-scores- each-assessment_of_basic_compe-__ ee 


‘tency for the students in his or her group. If a student has demonstrated 

+ mastery, the date of the assessment is entered in the student's Pupil 
Progress Record. If a studerit demonstrates mastery when retested, that 
date is also recorded. If a student fails to demonstrate mastery when 
retested, the original date is erased, and’ he or she must demonstrate 
mastery again before it is thus recorded. - Each mentor is assigned a coun- 
selor for assistance in understanding the intent of a competency or in 

> administering an assessment. . 


Most districts also have a district coordinator, appointed either’ -by 
the tistrict or by the state, who is responsible for delivering the tests 
to teachers and counselors, collecting them for scoring and analysis, and * 
ensuring test security. se . , 3 . 9 


“ 
‘ 


Scoring ‘and Analysis . ‘ 
About one-half of the state programs and two-thirds of the local 
district programs score and analyze the tests themselves, either by hand 
or with a computer. Slightly less than one-half of the state programs 
and the remaining one-third of the local district programs send all or 
part of their tests either to a consulting agency or to the test publisher 
for scoring.and for an analysis of scores according to classroom, school, 
district, etc. A few of the state programs give local districts options ' 
as to who will score tests. As yet, some programs have not made decisions 
about scoring and analysis. . . we 


— Reporting/Dissemination - | i... 


“ 


“= Metheds: of reporting: information about test- seores- are similar ing 


t-their-—locat—test_results-to—the—-—-—-— 
State Board of Education.’ In most cases, any information that does -not 
permit the identifdcation of individual students or teachers is open to 
the public and often released to the media, 7 ) 


“Summarized in Table 14 are the numbers of state and local programs 
- who send reports of their. programs to various groups. In all, 24 state 
- programs reported that they send results. to admtnistrators and 23 to 
boards of education. The next most frequently specified group was stu- 
dents. By contrast, local prégrams cited parents and students’ as the 
predominant groups receiving results. The third and fourth most fre- — - 
"quently cited groups were teachers and administrators, respectively.. 


Provisions for Special Populations 
Both state and local programs recognize vartous special populations - 
and make provisions for testing these -groups on the requisite competen- . — 

ties. Among the groups recognized are special education students (with - 
some programs distinguishing among types of impairment, e.g., deafness, 

-blindness, emotionally handicapped), multilingual or non-native speakers 
of English, children of migrant workers, and transfer students. In- _ 
tailoring a minimum competency testing program to the ‘needs of these. 
special groups, some programs simply exempt groups, others prepare tests 
with different formats (e.g., Braille) or administer the test differently 

 (e.g., reading it aloud), and still others,permit students to take tests ~ 
that differ from the typiéal minimun competency test in contént. -In addi- 

tion to provisions such as these, sane. programs permit tests to. be scored 
differently, i.e., according to different standards, and some choose to 
consider each member of a special population on a case-by-case basis. 

Finally, some state and local programs have yet’ to make such provisions - 

., and are in the process of studying this issue or, as in the case of some | 


> 
: _ & 
Dissemination of Results: Number of State and Local 
Programs SeAding Reports to Various Groups 


Number of Programs 


Reports Sent To: 


Teachers 15 
School Administrators 14 
Board of Education 4 
"Legislators - 0 
Parents 18 
Students 18 
x ; > 
f- : 
; » . * 
— #30- 


ing to different procedures. In New York, for example, allowances made for... 
Special education students salar Pichia Piel ei handicap, taking a a 
longer time to complete the test, using a-calculator, taking the test ings 
Braille and having the test read aloud. — s | _ «A wen 2 : 
One program, California's,.explicitly atlows local districts to set’ . 
differential standards for special education students and the State _ 
Department of Education addresses this topic in its technical assistance 
manual. Nonetheless, it: should be noted that cases whére a.student may be — 
- exempted formally from the testing as el he student$s-individual Edu- .”: 
cation Plan (IEP).may.be ‘Yewritten to include sone or all. of the competen-° 
cies that are required of regular students. “In such cases the mode of . 
assessment and/or the level of. performance required may be alteredgin 
order to better accommodate the needs of the special education student. 


Similarly, with respéct to preparing tests that differ in content : 
from the regular minimum confpetency tests, three local programs make such. .. - 
a provision for. some or ib Rds a ea education students. These = 
pra- vistons generally call for tailoring-the minimum competencies. to the ‘eu adg Me 
needs of particular special education students. | : sak 


Rather than make any specific provisions .for special education stu- - 
dents, two.states: and seven local programs have elected to treat all or a 
some of these students on a case-by-case basis.- Finally, in states such. ~ 
as New Jersey, other provisions are'mage; in. this state specfal education -*": 
students are not required to, huti.may take the regular tests. In Virginia — 
“students may choose to delay teSttg. ge ; S02 eo ae a 


Lo aoe! 1 me ; 2 . - 7 = .- “ ns ie ; - 
The next most frequently recognized roup ‘of students:.are those who © = |) | yh 
are. limited in their ability to speak €nglish or who afe multilingual, 


_,More states than aishuuets make sPeyel provisions for these students... At 


4 : . « ; . . : 3 ’ aoe “8 
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Special Cducatiea-- 
— hearatng Oisanted | 


Teats with Olfferent 
Formats /Administras 
tion Procedures 


Tests with Oi fferent 
Content ‘ 


" Olfferential Stans 
darts Permitted 


Case-dy-case 
Decisions . 


’ . 
Other ay Students 
tested under other 
programs, students 
ny elect to delay 
taking tests) 


Massachusetts 
Michigan 
New Jersey 
Virginia. 
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Previnians for Spectel Pepulettons* 


Wultilinguales 
Lind tea Enel {the 
1 Speaking 


—~™ *'This chart {a based on specifically stated provisions for specifically identified 


preclude the possibit 


‘decisions arise. 
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(ty that programe qake provisions on a case-by-case basis as atk 


Vations, {t does not 
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to test administration, 


Program Resources | be 4 


\ 


the state level, three states exempt: all or some es er students 
from taking minimum competency tests, while three other states either 
: administer the tests differently or use tests with different formats. New ‘| 
ou... Jersey, for example, is considering the possibility of developing equivae ow 
ie ae te BELUGA of ce hl riety of other provisions—are-made. - 2 
@ 


in states such as Arizona, Georgia, Florida, and Virginta. In Florida 


multilingual students may be. exempted from ye Pel tests if ey 
ss than two years prior — 


been enrolled in an English-speaking school for 


With respect to children of migrant workers; one state and one 


‘ 


California is attempting.to develop guidelines on how students moving: 
between districts can sa€isfy competency standards which are, by. state. 


law, set individually by the districts. In Lawton, Michigan administra- ~~ 
tors are determining specific provisions to apply to its sizeable migrant 


population. = 


- Three states make arrangements for transfer stlidents. In Massa- 
chusetts districts may omit from their summary reports to the state scores 
of students, who have transfered to the district after the tenth grade. In 


Idaho,- whieh is a district-option testing program, provisions are made for 


students who move from a participatingito a non-participating district;. 
these students are given Opportunities td,continue competency assessments. 
Students mastering the competencies then receive a state seal on their — 


_ diplomas. ; 


a. 


‘ 
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. General staffing. Although some: programs Have contracted with con- 
sulting agencies Tor developing their minimum competency programs, the ~ 


- staffing for the program usually comes from agencies within each state or 
local district. About three-fourths of the state programs and half-of the - 


local district programs are staffed primarily by assessment specialists. 
Most of the others’ are staffed by curriculum specialists. 


Funding. sources. .The state providés the bulk of. the funding for 20 


of the state programs: and one of the local programs studied; 15 of the 


local programs and 10 of the state programs are supported primarily at the“ 


local level. California, for example, mandates both testing and remedial 
programs for its students, but most of the funds for the development: of 


these programs must come from the local district budgets. A few-State and 


local programs have received federal “funds for program 


wo 


ee local program either has made or is planning to make specific provisions. i — 


cap e. 


development. Six states have received funds under Titles I, III, or IV, 
while seven local programs’ have received.money under Titles I, IV, V, or | 


VI. Funds have bean used/for a yar lety of purposes, including providing a “ 
fnieservice training and #rogram dissemination. — ees ee ek Oe ee 
Evaluation * ) / 2e re 


: : . * * 
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Seven states and four local districts have already conducted ‘evalua- 


ies ttons--of-thetr* competency-testing programs. —-Others;-such-as—Delaware,-plan—- , 


to. do so.when their testing programs are fully implemented. In some cases 
the evaluation’ has beer conducted by an outside agency under contract ito 
the state or district. ‘In others, evaluative feedback has been solicited 
by state and local personnet. In aa i Florida and Michigan, studies 
have been commissioned by groups affecte@ by the programs; in these@ states 
the National Education Assoctation in conjunction with the state chapter 
of the organization has sponsored reviews of the program. 


Programs in which evaluations have been contracted out include New: 
Hampshire and Fitchburg, Massachusetts. In the case of New Hampshire, 
faculty from Keene State College, Keene, New Hampshire reviewed all pub- 
lished and’ unpublished materials from the New Hampshire Accountability 
Project ahd interviewed key figures from various groups (e.g., teachers 

d adm{nistrators). In the final report submitted in June 1979, the 
Avaluators reviewed the technical assistance prqvided by the state and 
Y offered recommendations concerning the future role of the state-level 
‘advisory committee, dissemination efforts, measuring. the impact of 
thé Project, and funding to local districts. The Co-Directors of the 
Aécountability Project consider this an initial evaluation and are : 
_ Anvolved in contracting for a five-year longitudinal study to measure 
- program impact upon student performance. mS 
| oo - = 


| In Fitchburg, Massachusetts an initial evaluation was conducted by 
“an outside contractor’ during the first year of program implementation. — 
The results of this evdluation were used in: devehoping the current Skil] 
Ach{evement Monitoring system (SAM). In Spring 1978, Fitchburg adminis- 
trators contracted: with the Research.and Development Center for Teacher 

* Education at’ the University of Texas to study the use of SAM in the 
classroom, At the same time, administrators solicited the reactions 

of gtydents and teachers through questionnaires. These studies revealed 
that there.was potential for further staff development in the use of SAM, 
At present, Fitchburg. is planning further studies, using both district and 
outside personnel. . 


s 
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- Some states, such as Delaware, ane -currently developing procedures to 


evaluate program impact. In Delawaré the Department of.Education will be 
using on-site interviews couphed with measurement of student performance 
to. assess both district..implementation.of .the program_and its. tmpacts on... 
students. In other. states, such as Florida, responsibility for reviewing 
“the program has been shared by groups outside the Department of Educa- 
tion. In Florida, for example, the State Senate and House Education 
Subcommittees are responsible for gathering evidence (e.g., testimony) 
on such areas’ as the. effectiveness’ of program implementation. In Kansas 
the legislature will review the pesulte of the competency-based testing 
program implemented on a trial basis: for a two-year (1978-1980) program. 


_At_the nd of the second year legislators will decide.whether to implement 


such & program. permanent ly. i. | 


Finally, in addition to studies which are conducted either under con- 
tract to program personnel or by program personnel, there are two cases iff 
which panels have been formed to study particular programs. In 1978, under 
contract to the National Education. Association and the Florida Education 
Association, Ralph Tyler headed a five-member panel to study the implemen- 
tation of the florida statewide assessment program. In 1974 Ernest House, 
along with Wendell Rivers and Daniel Stufflebeam, prepared an assessment 
of the Michigan state program; this group was under contract to the NEA and 
the Michigan Education Association. These studies have generally been 
critical of various aspects of the programs, and in,Michigan, the findings— 
prompted a formal reply to House -et al. from the Michigan Department of 
Education. The Department, for example, questioned the criteria used by 
the investigators, and rebutted criticisms of the procedures used for: con- 
structing the test and the-utility of the information yielded by the. pro- 
gram. - In Florida criticism centered around the’ schedule of implementation, 
an issue. which has since been resolved in court (see section on associated 
litigation). 


° 


“Future Directions. 


Future tect teenie by program personnel include phasing in 


ae requirements, eee expanding program components , 


e.g., investigating the possibility of phasing out state instr ts in 
favor of locally developed ones), and determining whether to implement. 
minimum competency testing on a permanent basis. 

. Georgia is among those states introducing graduation.requirements over 

a period of time. By 1981 Georgia will have developed a tenth-grade basic. 
skills test to assess the competencies identified as necessary to fulfill 
the role of a learner in society. By 1982 local districts: must develop 
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ways to assess the competencies associated with other selected life roles; 
i.@., that of an individual, a consumer, a citizen, and producer. Begin- 

_ ning with the class of 1986, students must master all the competencies. 
This state will also be involved in disseminating the information and 
‘materials generated by the ten pilot sites that are currently developing — 
competency-base systems of education. . | 

: VQ. a + ; : ; 

Mithigan plans to expand’ its competencies te include life skills. 

The state foresees implementing such a test on a preliminary basis at the 
secondary level. . ': 4 


Nevada is currently planning program improvements. For example, pros. 


gram personnel are studying ways to identify fast and accurate test readers 
,to do holistic scoring and to improve {io improve given to test readers. 
‘The Department, is also considering way to improve the training of test 
administrators. eo . 


In Fitchburg, Massachusetts Sr eal administrators plan to study the 
relationship between thewscores attained byestudents on Skill Achievement 
Monitoring (SAM) tests and those obtained on the state-developed secondary 
test of minimum-basic skills. If, for example, scores on SAM are a good 
predictor of scores on the state test, the possibility exists for phasing 
out the state test entirely and using SAM tests to certify mastery of the 
skills required for graduation. 7 


he 


The state program in North Carolina is another example of one in which 
, a series of studies on various topics is being planned. There the Depart- 
ment of Public Instruction is preparing to coriduct more extensive test 
-analysis- with pany cue attention to item distractors, to'examine current 
— procedures for setting cutoff scores, to review remediation programs, to 
oe consider in depth the needs of exceptional children tn relation to the Peg 
_ testing program, to relate failure rates to school and socio-economic 
factors, and to compare teacher judgments of student achievement with stu- 
dent test performance. 


- Finally, in contrast to plans for program improvement or expansion, 
the Kansas Department. of Education reports that legislators in 1980. will 
consider the question of whether to initiate competency testing on a perma- 
nent basis. At present, Kansas has a mandate to conduct a two-year pilot 
study,: the results of which will be presented to legislators in 1980. 
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